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(57) ABSTRACT 

For \ise in a low-power digital imaging devices, for example 
a low-power single CCD-based digital camera, particularly 
in a battery-operated camera, a method for implementing 
video signal processing is provided wherein a single ampli- 
fier is employed in switched but parallel and uncorrelatcd 
signal paths in a manner which avoids fixed pattern noise 
that would be introduced by mismatches in gain and offset 
in various paths. The desired effect is achieved through use 
of a controller that switches appropriate sets of capacitors in 
parallel paths to establish different gains for each pixel 
component. The invention achieves power savings and flex- 
ibility to independently control gain of each color compo- 
nent. 

14 Claims, 7 Drawing Sheets 
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POWER SAVING METHOD USING 
INTERLEAVED PROGRAMMABLE GAIN 
AMPLIFIERANDA/D CONVERTERS FOR 
DIGITAL IMAGING DEVICES 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

This invention relates to digital camera technology and 
more particularly to a digital camera having reduced power 
consumption. 

Interleaving or ping-pong processing of digital color 
signals in an analog to digital converter is a known technique 
for processing signals through switched capacitor circuits. In 
interleaved processing, there is an inherent mismatch 
between the passive components used in the two phases, the 
"ping*' path and the "pong"' path. The difference or mismatch 
in gain and offset creates fixed pattern noise which in a video 
signal would be manifest as a spatial frequency tone. Thus 
ping-pong processing has never been known to be used in 
programmable gain amplification for video signal process- 
ing. 

It is helpful to understand the structure of a class of single 
chip CCD video sensors, such as that which incorporates the 
Bayer pattern. RGB pixels are arranged in a distinctive 
pattern so that a progressive scan through two adjacent lines 
produces aU of the red, green and blue values. The Bayer 
pixel pattern looks like the following, noting the adjacent 
RGB pixel group: 

A. RGRGRGRGRGRGRGRGRG 

B. GBGBGBGBGBGBGBGBGB 

In the prior art, all color video signals were passed 
through a single analog channel or path without switching, 
treating R, G and B identicaUy with the same gain, to 
produce aUernating colors sliced by time. There was a 
problem with lack of gain control over the separate color 
components. In order to provide for separate control of gain 
on each component, it would be necessary to provide 
separate signal paths, including separate amplifiers in each 
path. 

2. Description of the Prior Art 

CCD signal processors for electronic cameras are known, 
as evidenced by devices such as Analog Devices part 
AD 9802 as described in its Specification Sheet dated at least 
as early as 1997. FIG. 19 thereof, reproduced herein as FIG. 
1 (Prior Art), 5 illustrates a single path processor employing 
independent amplifiers 12, 14 feeding a single program- 
mable gain amplifier (PGA) 15 as controlled by a controller 
19. Because of the inherent mismatch, two different PGAs 
16, 18 are used in alternate feedback paths. 

While two input paths are shown, there is nothing which 
conceptually requires two feedback paths except correction 
of the inherent mismatch. 

Switched capacitor gain stages coupled in parallel signal 
paths have been used in parallel pipelined analog to digital 
converters are known, as for example described in W. 
Bright, "8b 75MSample/s 70mW ParaUel Pipelined ADC 
Incorporating Double Sampling," ISSCC98, Feb. 6, 1998, 
(IEEE 0-7803-4344-1/98) p. 146. The switched capacitors 
arc used during non-overlapping alternate clock phases. Due 
to natural fabrication limitations in integrated circuits, the 
accuracy of the foregoing design is limited to about 8 bits. 
Any gain and offset mismatch, as a result of inherent passive 
component mismatches in the two paths, introduces an 
undesirable noise pattern, manifest as noise or a tone. 

In conventional CMOS technology, switched capacitor 
gain stages are implemented by switching among capacitors 
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in a synchronized non-overlapping phase pattern to produce 
a desired output. The switched capacitor topology is com- 
mon to various building blocks in a correlated double 
sample clement (CDS), a programmable gain amplifier 

5 (PGA) and pipeline analog to digital converter (ADC), 
which arc coupled in scries in prior art configurations. 
However, in integrated circuits, natural fabrication mis- 
matches between the ratio of capacitors limits the accuracy 
of the gain to be no more than about 8 to 9 bits. Any such 

10 gain mismatch between the even and the odd samples 
introduces an undesired tone or spurious modulation in the 
signal path equivalent to a fixed pattern noise. Parallel path 
switched capacitor circuits can share a common amplifier. 
While the architecture provides much lower power 

15 dissipation, the spurious artifacts make this circuit unusable 
in certain desired applications where noise or spatial fre- 
quency tones are intolerable. 

SUMMARY OF THE INVENTION 

^ According to the invention, for use in a low-power digital 
imaging devices, for example a low-power single CCD- 
based digital camera, particularly in a battery-operated 
camera, a method for implementing video signal processing 
is provided wherein a single amplifier is employed in 

^ switched but parallel and uncorrelated signal paths in a 
manner which avoids fixed pattern noise that would be 
introduced by mismatches in gain and offset in various 
paths. The desired effect is achieved through use of a 
controller that switches appropriate sets of capacitors in 

■^^ parallel paths to establish different gains for each pixel 
component. The invention achieves power savings and flex- 
ibility to independently control the gain of each color 
component. 

The invention will be better understood upon reference to 
the following detailed description in conjunction vnih the 
accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

40 FIG. 1 is a block diagram of a prior art subsystem as 
previously described. 

FIG. 2 is a circuit diagram of a two phase circuit accord- 
ing to the invention employing a two-phase clock/controUer 
as hereinafter explained according to the invention. 
^5 FIG. 3 is a block diagram of a system according to the 
invention with a clock controller. 

FIG. 4 is a circuit diagram of a three phase circuit 
according to the invention responsive to a three phase clock 
controller according to the invention. 

FIG. 5 is a timing diagram of a three phase circuit 
according to the invention used for three color components. 

FIG, 6 is a circuit diagram of a further three phase circuit 
according to the invention. 
55 FIG. 7 is a block diagram illustrating a system incorpo- 
rating circuits such as the embodiments of FIG. 4 and FIG. 
7. 

DETAILED DESCRIPTION OF SPECIFIC 
EMBODIMENTS 

ou 

A parallel signal path embodiment 108 is shown in FIG. 
2 wherein two sets of capacitors (CI. C2); (C3, C4) are used 
during alternating phases of the controlling clock signals 
01, 02 horn a controller 109.^Tlieloles^f the capacitor^ 
65 C270rC4.arechanged every other clock cycle-so Tliat the 
it^^ts of capacitorssh the .operational^amplifiet^OO 
such jhatit.iosed for-the- entire clockx@^ a first 
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non-overlappiog phase of two phase clocks, the switdies because the successive samples ate from different color 

SIA, SIB and SIC are closed and the input signal is sampled sensors. Moreover, the sensitivity of photo detectors in the 

onto capacitors CI and C2. During the second phase of the sensor array is color dependent, so different gains are needed 

clock, which is likewise non-overlapping with the first in the PGA 140 (FIG. 3) to produce optimum signal ampli- 

phase, capacitor CI is connected to the output (in the 5 tude input at the input to the ADC WO. Gain compensation 

feedback loop) through switch S2A. The capacitor C2 is applied via the ratio of capacitors (RG. 2). 

simultaneously comiecled to signal ground through switch ^^ ^ g ^^^^ ^^^^ ^^j^,^^^ 

S2B and the common node of the capacitors ^ connected to ^ . ^ „,^ssary;fofThe 

toe mput of the operational ampLfler 200 through switch ^j^^^^ ^^ be switShed into the 

S2C. TTie paths alieraate with non-overlappmg phase fol- ^ Q^g^j^ signal_from^/B line. To this 

lowing the tngger of a pixel clock operaUng at the samplmg ^ appropriate timing^fondiSi of the controller 109 is 

rate. Similarly, the oontioller 109 controls the switching of sigaal?ffi accordance with the phase clocks 

the capacitors C3 and C4 in alternating scquencc_with j • i i i<4^ -l j • *• i on. 

•r J ^r^r-— ^t'— ^• —r.Tr^ — f_ .T^ aJid pixel clock descnbed m connection with FIG. 2. Thus, 

capacitors CI and C2i It is the ratio of the capacit ors wh ich/ .-^-^ *i. r^nr-i-xt i • j j u *, ^i. 

, ^ . . ^1 1— » . .1 — .""^r^^r^T^^ — ' pattera'noise on the GREEN color is avoided between the 

.^tCTmmes thegam of agnak^apphe^^^^^ ^df^id the even lines or signal samples. 

^Operational amplifier 200. Signal gam for even signal^ . .„ T , ^^^^ ^ , • 

^sainplEs-is'(Cl+C2)7cl)T_aHd-foT:odri^al ^ ^lesTs^ FIG. 4iUustrates as6condembodmentU0of them^x 

4G3+C4VC3^>" — jr__,_^ suited to other types of RGB patterns, such as found m 

. ^- • 1 • i_ scanners. By way of contrast, a prior approach would be an 

According to the invention, the signal gain can be^pre- j , r ^i! c 1- r t-t>. i l 

Jo . . 1 jT • 11 ^ adaptation of the configuration of FIG. 3 wherein one 

programmed for each signal path, and typically as often as on SI. . / * u \ i j u- * * ^ *u 

^ ^ ,. „ 1 / 11 1- Kt. • 1- multiplexer (not shown) would combine the outputs of three 

once per bne. For example, for a^^i bnes, the mut signal is ^pg/^^O to feed into a single PGA 140 or another multi- 

routed along signa path 1 for aU pen pixels, which are ^^^^ ^^^^ ^^^^^ ^ p^^ 

preprogrammed With a gam established by^a combination of ^An, \ j-* • i at^oi^a 

•f oi ^ r^I J i^T5 f^<J jx r^n * 140 to feed mto a Single ADC 160. 

capacitors CI, C2, CA and CB./CA-^and CB represent , . . . , . „ , . . 

capacitance elements that can be a-^^d in parallel to CI and f ^^"^^ '^^^''T''' ^''^X'f^^^l^^i^'i'^t 
C2 respectively, upon acUvaUo^ 6f switches Sw and Sx. For f ^^^.^J^^' I "^"^^ .^^^ ^^^^^ 
odd Unes, the input signalls^outed along signal path 2 for 160, each such circuit employing one opera- 
all red pixels, which arip^eprogrammed with a gain estab- tional amphfier 200 havmg their mput switched among three 
Ushed by a combination of capacitors C3, C4, CC and CD. ^1^^^ P^^^^ ^^^y/ ^hree different time multiplexed input 
CC and CD represent capacitance elements that can be 30 signals for R, G and B. 

added in pardlel to C3 and C4 respectively, upon activation PIG- ^ illustrates one fuU cycle of the three phase sample 

of switches^Sy and Sz. During even lines, the input signal is clock according to this embodiment of the invention. The 

routed^long signal path 2 for all blue pixels, which arc sample clock XCLK operates at three times the pixel rate 

prepro^ammed with a different gain established by the (trace X) triggered on leading edges corresponding to phases 

comijination of capacitors C3, C4, CC and CD. 35 ii» iii. h etc. Phase 1 terminates at A after the leading edge 

Referring to FIG. 3, there is shown a block diagram of a ^^^^^^ ^^^ck ii and stays inactive until B, which occurs 

first device 100 operative according to the invention opti- ^^^^ ^ ^^^^y following the next Phase 1 trigger 1 and the 

mizcd to process Bayer pattern input signals (as defined in P^^^^^ ^ sample window at F, which also foUows i. Phase 2 

U.S. Pat. No. 3,971,065) from a CCD or other photo detector similarly samples during a non-overlapping window 

sensor array. The system comprises a CDS 120, a PGA 140 40 ^'^^^^^ ^ ^""^ °' ^^^^ ^ ^°^P^^^ ^^^g 

and an ADC 160 controlled by a timing controller 180. For overlappmg window bounded by E and F. 

thcpurposesof this discussion the topology of the CDS 120, Each of the three input paths shown in HG. 4 are 

PGA 140 and ADC 160 is essentially the same in that input controlled by three phases, 01, 02, 03, which control 

of an operational amplifier 2(M) as shown in FIG. 2 is switching in the same way as the rules governing the two 

alternately fed by two parallel input sets through paired 45 i^iput paths of FIG. 2. The circuit of FIG. 4 is modified to 

switches (S2A, S2C) and (SID, SIF). Signal input is sup- accommodate an additional phase, thus being able to share 

pHed to CDS 120, then supplied to the PGA 140, then the operational amphfier stage 200 among three signal paths, 

supplied to the ADC 160. According to the invention, the FIG. 6 illustrates a farther embodiment 1100 wherein the 

timing controller 109 is a global timing generator handling RED, GREEN and BLUE inputs are not time multiplexed on 

a pixel clock (XCLK), a vertical synchronization clock 50 a single line but which are provided from three separate 

(V_SyNC) and a horizontal synchronization clock sources. This embodiment 1100 is suitable for implementa- 

(H_SYNC), and controls the clock phases of CDS 120, tion of a multiplexing/gain stage in a system illustrated in 

PGA 140 and ADC 160. FIG. 7. Therein three CDS devices 121 carry respective R, 

The processing of a Bayer pattern input signal RGRGRG G and B signals; one path is fed straight through to the 

from a CCD or other photo detector sensor array is insen- 55 element 1100. The other two devices 121 feed respective 

sitive to mismatches between parallel processing paths sample and hold circuits 123 which introduce phase delay to 

because the successive samples are from different color the element 1100 to respond to each of the signals 

sensors. The odd samples correspond to color RED (R) seriaUy. The output is fed to a PGA 140 according to the 

signals, while the even samples correspond to the color embodiment of FIG. 2, and to an ADC of the embodiment 

GREEN (G) signals. There is a fixed assignment between 60 of FIG. 2. 

colors and paths. Although there is a mismatch between Circuitry according to the invention can reduce power by 

paths, there is no intrapath intracolor fixed pattern noise, a factor of two compared to conventional technology, which 

since the RED samples are processed in one path and the is a particularly valuable advance for battery-powered por- 

GREEN samples are processed in another path. Similarly, table devices. 

processing of a Bayer pattern input signal GBGBGBGBGB 65 The invention has been explained with reference to spe- 

from a CCD or other photo detector sensor array is also cific embodiments. Other embodiments will be apparent to 

insensitive to mismatches between parallel processing paths those of ordinary skiU in the art For example, whUe all 
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illustrations used herein are of single -ended circuitry, most 
implementations would employ fully differential circuitry. 
Furthermore, while it is conventional to employ three pri- 
mary colors, it is contemplated that greater numbers of 
primary colors cotild be used to effect a desired color image. 
It is therefore not intended that the invention be limited, 
except as indicated by the appended claims. 
What is claimed is; 

1. A method for processing color component signals 
comprising the steps of: 

providing first and second successive component samples 
alternately to a first sampled signal path and a second 
sampled signal path in a first arbitrary phase and in a 
second arbitrary phase respectively, said first arbitrary 
phase and said second arbitrary phase being arbitrary 
nonoverlapping phases, each sampled signal path com- 
prising a set of capacitors, the ratio of preselected 
values of which establish a preselected gain for said 
each signal path; and 

outputting signals from said first sampled signal path and 
said second sampled signal path alternately in said 
second arbitrary phase and in said first arbitrary phase 
respectively, through a single channel amplifier of a 
pipelined processing path, 

2. The method according to claim 1 wherein said com- 
ponent samples are interleaving Red component/Green com- 
ponent and Green component/Blue component. 

3. The method according to claim 2 wherein each prese- 
lected gain is implemented by at least one additional 
optional capacitance element for programming said each 
preselected gain. 

4. The method according to claim 1 wherein each prese- 
lected gain is implemented by at least one additional 
optional capacitance clement for programming said each 
preselected gain. 

5. A method for processing color component signals 
comprising the steps of: 

providing a first component sample to a first sampled 
signal path at a first arbitrary phase; 

providing a second component sample to a second 
sampled signal path at a second arbitrary phase non- 
overlapping with said first arbitrary phase and a third 
arbitrary phase; 

providing a third component sample to a third sampled 
signal path at said third arbitrary phase nonoverlapping 
with said first arbitrary phase and said second arbitrary 
phase; 

each sampled signal path comprising an array of 
capacitors, the ratio of preselected values of which 
establish a preselected gain for said each signal path; 
and 

outputting signals firom said first sampled signal path at 
said second arbitrary phase or said third arbitrary phase, 
from said second sampled signal path at said first 
arbitrary phase or said third arbitrary phase, and from 
said third sampled signal path at said first arbitrary 
phase or said second arbitrary phase through a single 
channel amplifier of a pipelined processing path. 

6. The method according to claim 5 wherein said com- 
ponent samples are interleaving Red component, Green 
component and Blue component. 

7. The method according to claim 6 wherein each prese- 
lected gain is implemented by at least one additional 
optional capacitance element for programming said each 
preselected gain. 
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8. The method according to claim 5 wherein each prese- 
lected gain is implemented by at least one additional 
optional capacitance element for programming said each 
preselected gain. 

9. The method according to claim 5 wherein said first 
sampled signal path, said second sampled signal path and 
said third sampled signal path are coupled to a common 
signal source. 

10. The method according to claim 5 wherein said first 
sampled signal path, said second sampled signal path and 
said third sampled signal path are each coupled to separate 
signal sources. 

U. An apparatus for processing color component signals 
comprising: 

a first sampled signal path and a second sampled signal 
path, the first sampled signal path comprises a first set 
of capacitors for receiving first component samples in 
a first arbitrary phase, the second sampled signal path 
comprises a second set of capacitors for receiving 
second component samples in a second arbitrary phase, 
said first arbitrary phase and said second arbitrary 
phase being arbitrary nonoverlapping phases, the ratio 
of preselected values of said capacitors establish a 
preselected gain for said each signal path; 

a single chaimel amplifier coupled to receive output 
signals from said first sampled signal path in said 
second arbitrary phase and said second sampled signal 
path in said first arbitrary phase; and 

means for clocking inputs and outputs of each of said 
sampled signal paths alternately in said phases through 
said single channel amplifier at each stage of a pipe- 
lined processing path. 

12. The apparatus according to claim 11 further compris- 
ing means for programming capacitance value of said 
capacitors. 

13. An apparatus for processing color component signals 
comprising: 

a first sampled signal path; 

a second sampled signal path; and 

a third sampled signal path, 

each said first, second and third sampled signal path 
comprising a set of capacitors for receiving first, sec- 
ond and third successive component samples in a first 
phase, in a second phase, and in a third phase 
respectively, said first phase, said second phase and 
said third phase being arbitrary nonoverlapping phases, 
the ratio of preselected values of said capacitors estab- 
lish a preselected gain for said each signal path; 

a single diannel amplifier coupled to receive output 
signals &om said first sampled signal path in said 
second phase or said third phase, &om said second 
sampled signal path in said first phase or said third 
phase, and from said third sampled signal path in said 
first phase or said second phase; and 

means for clocking inputs and outputs of each of said 
sampled signal paths alternately and respectively in 
said arbitrary nonoverlapping phases through said 
single amplifier at each stage of a pipelined processing 
path. 

14. The apparatus according to claim 13 further compris- 
ing means for programming capacitance value of said 
capacitors. 
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